Something from nothing: Augmenting a paper- based work practice via multimodal interaction
نویسندگان
چکیده
In this paper, we describe Rasa: an environment designed to augment, rather than replace, the work habits of its users. These work habits include drawing on Post-it notes using a symbolic language. Rasa observes and understands this language, assigning meaning simultaneously to objects in both the physical and virtual worlds. With Rasa, users rollout a paper map, register it, and move the augmented objects from one place to another on it. Once an object is augmented, users can modify the meaning represented by it, ask questions about that representation, view it in virtual reality, or give directions to it, all with speech and gestures. We examine the way Rasa uses language to augment objects, and compare it with prior methods, arguing that language is a more visible, flexible, and comprehensible method for creating augmentations than other approaches.
منابع مشابه
Multimodal interaction with a household appliance based on haptic, audio and visualization
Virtual Prototypes (VPs) are currently substituting physical ones in some activities of the product development process, being more flexible, sharable and easy to modify. Several companies that currently make use of this practice have put effort in the improvement of visualization techniques and of the level of quality of the information that is visually represented, which is indeed very high. ...
متن کاملMultimodal authentication on smartphones: Combining iris and sensor recognition for a double check of user identity
Iris recognition on mobile devices is a challenging task, performing acquisition via the embedded sensors can introduce the sensor interoperability problem. Biometric systems developed so far are limited in their ability of comparing biometric data originated by different sensors because they operate under the assumption that the data to be compared are obtained using the same sensor. This prob...
متن کاملA Multimodal Approach toward Teaching for Transfer: A Case of Team-Teaching in ESAP Writing Courses
This paper presents a detailed examination of learning transfer from an English for Specific Academic Purposes course to authentic discipline-specific writing tasks. To enhance transfer practices, a new approach in planning writing tasks and materials selection was developed. Concerning the conventions of studies in learning transfer that acknowledge different learning preferences, the instruct...
متن کاملTowards an Architecture Model for Emotion Recognition in Interactive Systems: Application to a Ballet Dance Show
In the context of the very dynamic and challenging domain of affective computing, we adopt a software engineering point of view on emotion recognition in interactive systems. Our goal is threefold: first, developing an architecture model for emotion recognition. This architecture model emphasizes multimodality and reusability. Second, developing a prototype based on this architecture model. For...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000